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AMENDMENTS TO THE CLAIMS 

1 . (Currently Amended) A method for generating a wide image video sequence of 
a scene being recorded using a device having at least two video cameras substantially co-located 
in a predetermined relationship to each other such that there will be an overlap between images 
from the respective cameras, said method comprising the steps of: 

a. identifying corresponding lines in overlapping parts of the images from the 
respective cameras; 

b. calculating a projective transform for pixels of the images from at least one of 
said cameras based on slopes and positions of said corresponding lines, which said projective 
transform compensates for the relative rotation between the at least two video cameras a 
relation between said corresponding lines ; 

c. synchronously recording video sequences using each of said at least two video 
cameras; and 

d. generating a wide image video sequence by combining said synchronously 
recorded video sequences using said projective transform. 

2. (Previously Presented) A method according to claim 1, wherein the 
synchronously recorded video sequences are stored in a memory storage area. 

3. (Canceled) 

4. (Previously Presented) A method according to claim 3, wherein the wide image 
video sequence is transmitted live. 

5. (Previously Presented) A method according to claim 3, wherein the wide image 
video sequence is stored on a memory storage area. 
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6. (Previously Presented) A method according to claim 1 further comprising the 
following steps: 

a. starting a calibration process; 

b. synchronizing the sequences from each of the at least two cameras; 

c. computing inter-image projective transformations; 

d. using the transformations to refer each image to a common reference frame; 

e. selecting a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f selecting a rectangular region of interest within the wide image; and 
g. storing the computed values resulting from the calibration process to be used as 
calibration parameters. 

7. (Previously Presented) A method according to claim 6 further comprising the 
step of determining lens distortion parameters for each camera, and correcting radial distortion in 
each image. 

8. (Previously Presented) A method according to claim 6 further comprising the 
step of selecting non-linear distortion parameters to reduce perspective distortion of the wide 
image. 

9. (Canceled) 

10. (Previously Presented) A method according to claim 1 in which step c is 
performed automatically by an algorithm for identification of corresponding features in 
concurrent video images and the coordinates for the corresponding features are input via a 
computer means. 

1 1 . (Previously Presented) A method according to claim 1 further comprising 
performing the following steps until completing the generation of the wide image video 
sequence: 
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a. applying calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
computing and storing parameters describing (1) which pixels from which images contribute to 
the respective pixels in the wide image and (2) how much each of the respective pixels 
contributes to the wide image; 

c. retrieving one new image from each camera; 

d. selectively updating the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjusting intensities in the images from one or more of the cameras; 

and 

f creating the current seamless, wide image from the current images from each 
camera; 

g. outputting the wide image to a display or to a memory storage area. 

12. (Previously Presented) A method according to claim 1 1 , wherein the new images 
from each camera are read from live sources, each such source comprising a video camera. 

13. (Previously Presented) A method according to claim 1 1 wherein the new images 
from each video camera are read from a memory storage area. 

14. (Currently Amended) A device having at least two video cameras substantially 
co-located and arranged in a predetermined relationship to each other such that there will be an 
overlap between images from the respective cameras, a processor, at least one memory storage 
area, wherein the processor is configured to: 

a. identify corresponding lines in overlapping parts of the images from the 
respective cameras; 

b. calculate a projective transform for pixels of the images from at least one of said 
cameras based on slopes and positions of said corresponding lines, which said projective 
transform compensates for the relative rotation between the at least two video cameras a 
relation between said corresponding lines ; 
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c. synchronously record video sequences using each of said at least two video 
cameras; and 

d. generate a wide image video sequence of a scene being recorded by combining 
said synchronously recorded video sequences using said projective transform. 

15. (Previously Presented) The device of claim 14, wherein the synchronously 
recorded video sequences are stored in a memory storage area. 

16. (Canceled) 

17. (Previously Presented) The device of claim 14, wherein to calculate calibration 
parameters, the processor is further configured to: 

a. start a calibration process; 

b. synchronize the sequences from each of the at least two cameras; 

c. compute inter-image projective transformations; 

d. use the transformations to refer each image to a common reference frame; 

e. select a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f. select a rectangular region of interest within the wide image; and 

g. store the computed values resulting from the calibration process to be used as the 
calibration parameters. 

18. (Previously Presented) The device of claim 17, wherein to calculate the 
calibration parameters, the processor is further configured to determine lens distortion 
parameters for each camera, and correct radial distortion in each image produced. 

19. (Previously Presented) The device of claim 17, wherein to calculate the 
calibration parameters, the processor is further configured to select non-linear distortion 
parameters to reduce perspective distortion of the wide image. 



5 



In re: Carlsson et al. 

ApplNo.: 10/564,286 

Filed: January 1 1 , 2006 

Page 6 

20. (Canceled) 

21 . (Previously Presented) The device of claim 14, wherein step c is performed 
automatically by an algorithm for identification of corresponding features in concurrent video 
images and the coordinates for these corresponding features are input to a computer storage area. 

22. (Previously Presented) The device of claim 14, wherein the processor is further 
configured to: 

a. apply calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
compute and store parameters describing (1 ) which pixels from which images contribute to the 
respective pixels in the wide image and (2) how much each of the respective pixels contributes to 
the wide image; 

c. retrieve one new image from each camera; 

d. selectively update the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjust intensities in the images from one or more of the cameras; and 

f. create the current seamless, wide image from the current images from each 
camera; 

g. output the wide image to a display or to a memory storage area. 

23. (Previously Presented) The device of claim 22, wherein the new images from 
each camera are read from live sources, each such source comprising a video camera. 

24. (Previously Presented) The device of claim 22, wherein the new images from 
each video camera are read from a memory storage area. 

25. (Currently Amended) A computer-readable medium having computer-readable 
program code portions stored therein, the computer-readable program code portions comprising 
executable portions that cause a device having at least two video cameras substantially co- 
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located in a predetermined relationship to each other such that there will be an overlap between 
images from the respective cameras to: 

a. identify corresponding lines in overlapping parts of the images from the 
respective cameras; 

b. calculate a projective transform for pixels of the images from at least one of said 
cameras based on slopes and positions of said corresponding lines, which said projective 
transform compensates for the relative rotation between the at least two video cameras a 
relation between said corresponding lines ; 

c. synchronously record video sequences using each of said at least two video 
cameras; and 

d. generate a wide image video sequence of a scene being recorded by combining 
said synchronously recorded video sequences using said projective transform. 

26. (Previously Presented) The computer-readable medium of claim 25, wherein the 
synchronously recorded video sequences are stored in a memory storage area. 

27. (Canceled) 

28. (Previously Presented) The computer-readable medium of claim 25, wherein to 
calculate calibration parameters, the computer-readable medium further comprises executable 
portions that cause the device to: 

a. start a calibration process; 

b. synchronize the sequences from each of the at least two cameras; 

c. compute inter-image projective transformations; 

d. use the transformations to refer each image to a common reference frame; 

e. select a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f. select a rectangular region of interest within the wide image; and 

g. store the computed values resulting from the calibration process to be used as the 
calibration parameters. 
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29. (Previously Presented) The computer-readable medium of claim 28, further 
comprising executable portions that cause the device to determine lens distortion parameters for 
each camera, and correct radial distortion in each image produced. 

30. (Previously Presented) The computer-readable medium of claim 28, further 
comprising executable portions that cause the device to select non-linear distortion parameters to 
reduce perspective distortion of the wide image. 

31. (Canceled) 

32. (Previously Presented) The computer-readable medium of claim 28, wherein 
step c is performed automatically by an algorithm for identification of corresponding features in 
concurrent video images and the coordinates for the corresponding features are input to a 
computer means. 

33. (Previously Presented) The computer-readable medium of claim 28, further 
comprising executable portions that causes the device to: 

a. apply the calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
compute and store parameters describing (1) which pixels from which images contribute to the 
respective pixels in the wide image and (2) how much each of the respective pixels contributes to 
the wide image; 

c. retrieve one new image from each camera; 

d. selectively update the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjust intensities in the images from one or more of the cameras; and 

f. create the current seamless, wide image from the current images from each 
camera; 

g. output the wide image to a display or to a memory storage area. 
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34. (Previously Presented) The computer-readable medium of claim 28, wherein the 
new images from each camera are read from live sources, each such source comprising a video 
camera. 

35. (Previously Presented) The computer-readable medium of claim 28, wherein the 
new images from each video camera are read from a memory storage area. 

36. (Currently Amended) A video recording apparatus having at least two video 
cameras substantially co-located in a predetermined relationship to each other such that there 
will be an overlap between images from the respective cameras, the video recording apparatus 
comprising: 

a microprocessor (130); 

a memory storage area (120) storing a program for: 

a. identifying indentifying corresponding lines in overlapping parts of the 
images from the respective cameras, 

b. calculating a projective transform for pixels of the images from at least 
one of said cameras based on slopes and positions of said corresponding lines, which said 
projective transform compensates for the relative rotation between the at least two video 

c. synchronously recording video sequences using each of said at least two 
video cameras, and 

d. generating a wide image video sequence of a scene being recorded by 
combining said synchronously recorded video sequences using said projective transform, 

a read and write memory storage area (140) for storing data relating to recorded video 
sequences from the at least two video cameras; 

an input component (300) for receiving input of parameters, and input of recorded video 
sequences; and 

an output component (300) for outputting of a wide image video sequence. 
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37. (Previously Presented) A method according to claim 1, wherein said 
corresponding lines depict a line naturally occurring in the scene being recorded. 

38. (Previously Presented) A method according to claim 37, wherein the scene being 
recorded is a sports field, and wherein said line naturally occurring in the scene being recorded is 
a sports field mark line. 

39. (Previously Presented) A method according to claim 1 , wherein the step of 
identifying said corresponding lines is performed manually. 

40. (Previously Presented) A method according to claim 1 , wherein the step of 
identifying said corresponding lines is performed automatically. 

41 . (Previously Presented) The device of claim 14, wherein said corresponding lines 
depict a line naturally occurring in the scene being recorded. 

42. (Previously Presented) The device of claim 14, wherein the scene being recorded 
is a sports field, and wherein said projective transform refers each image to a common reference 
frame, and the processor is further configured to select said reference frame such that certain 
lines on the sports field become essentially horizontal and parallel in the wide image video 
sequence. 

43. (Previously Presented) The computer-readable medium of claim 25, wherein 
said corresponding lines depict a line naturally occurring in the scene being recorded. 

44. (Previously Presented) The computer-readable medium of claim 25, wherein the 
scene being recorded is a sports field, and wherein said projective transform refers each image to 
a common reference frame, and the computer-readable medium further comprises executable 
portions that cause the device to select said reference frame such that certain lines on the sports 
field become essentially horizontal and parallel in the wide image video sequence. 
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45. (Previously Presented) The apparatus of claim 36, wherein said corresponding 
lines depict a line naturally occurring in the scene being recorded. 

46. (Previously Presented) The apparatus of claim 36, wherein the scene being 
recorded is a sports field, and wherein said projective transform refers each image to a common 
reference frame, and the program is further for selecting said reference frame such that certain 
lines on the sports field become essentially horizontal and parallel in the wide image video 
sequence. 
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